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ABSTRACT 

Why should computers interpret language incremen- 
tally? In recent years psycholinguistic evidence for in- 
cremental interpretation has become more and more 
compelling, suggesting that humans perform seman- 
tic interpretation before constituent boundaries, pos- 
sibly word by word. However, possible computa- 
tional applications have received less attention. In 
this paper we consider various potential applications, 
in particular graphical interaction and dialogue. We 
then review the theoretical and computational tools 
available for mapping from fragments of sentences to 
fully scoped semantic representations. Finally, we 
tease apart the relationship between dynamic seman- 
tics and incremental interpretation. 



APPLICATIONS 

Following the work of, for example, Marslen- Wilson 
(1973), Just and Carpenter (1980) and Altmann and 
Steedman (1988), it has become widely accepted that 
semantic interpretation in human sentence process- 
ing can occur before sentence boundaries and even 
before clausal boundaries. It is less widely accepted 
that there is a need for incremental interpretation in 
computational applications. 

In the 1970s and early 1980s several computational 
implementations motivated the use of incremental in- 
terpretation as a way of dealing with structural and 
lexical ambiguity (a survey is given in Haddock 1989). 
A sentence such as the following has 4862 different 
syntactic parses due solely to attachment ambiguity 
(Stabler 1991). 

1) I put the bouquet of flowers that you gave me for 
Mothers' Day in the vase that you gave me for my 
birthday on the chest of drawers that you gave me 
for Armistice Day. 

Although some of the parses can be ruled out using 
structural preferences during parsing (such as Late 
Closure or Minimal Attachment (Frazier 1979)), ex- 
traction of the correct set of plausible readings re- 
quires use of real world knowledge. Incremental inter- 
pretation allows on-line semantic filtering, i.e. parses 
of initial fragments which have an implausible or 
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anomalous interpretation are rejected, thereby pre- 
venting ambiguities from multiplying as the parse pro- 
ceeds. 

However, on-line semantic filtering for sentence pro- 
cessing does have drawbacks. Firstly, for sentence 
processing using a serial architecture (rather than 
one in which syntactic and semantic processing is 
performed in parallel), the savings in computation 
obtained from on-line filtering have to be balanced 
against the additional costs of performing semantic 
computations for parses of fragments which would 
eventually be ruled out anyway from purely syntactic 
considerations. Moreover, there are now relatively so- 
phisticated ways of packing ambiguities during pars- 
ing (e.g. by the use of graph-structured stacks and 
packed parse forests (Tomita 1985)). Secondly, the 
task of judging plausibility or anomaly according to 
context and real world knowledge is a difficult prob- 
lem, except in some very limited domains. In contrast, 
statistical techniques using lexeme co-occurrence pro- 
vide a relatively simple mechanism which can imi- 
tate semantic filtering in many cases. For example, 
instead of judging bank as a financial institution as 
more plausible than bank as a riverbank in the noun 
phrase the rich bank, we can compare the number of 
co-occurrences of the lexemes rich and banki (= 
riverbank) versus rich and bank2 (= financial in- 
stitution) in a semantically analysed corpus. Cases 
where statistical techniques seem less appropriate are 
where plausibility is affected by local context. For ex- 
ample, consider the ambiguous sentence, The decora- 
tors painted a wall with cracks in the two contexts The 
room was supposed to look run-down vs. The clients 
couldn't afford wallpaper. Such cases involve reason- 
ing with an interpretation in its immediate context, as 
opposed to purely judging the likelihood of a particu- 
lar linguistic expression in a given application domain 
(see e.g. Cooper 1993 for discussion). 

Although the usefulness of on-line semantic filtering 
during the processing of complete sentences is debat- 
able, filtering has a more plausible role to play in in- 
teractive, real-time environments, such as interactive 
spell checkers (see e.g. When (1990) for arguments for 
incremental parsing in such environments). Here the 
choice is between whether or not to have semantic fil- 
tering at all, rather than whether to do it on-line, or 
at the end of the sentence. 

The concentration in early literature on using incre- 
mental interpretation for semantic filtering has per- 



haps distracted from some other applications which 
provide less controversial applications. We will con- 
sider two in detail here: graphical interfaces, and di- 
alogue. 

The Foundations for Intelligent Graphics Project 
(FIG)Q considered various ways in which natural lan- 
guage input could be used within computer aided de- 
sign systems (the particular application studied was 
computer aided kitchen design, where users would not 
necessarily be professional designers). Incremental in- 
terpretation was considered to be useful in enabling 
immediate visual feedback. Visual feedback could be 
used to provide confirmation (for example, by high- 
lighting an object referred to by a successful definite 
description), or it could be used to give the user an 
improved chance of achieving successful reference. For 
example, if sets of possible referents for a definite noun 
phrase are highlighted during word by word process- 
ing then the user knows how much or how little infor- 
mation is required for successful reference.^] 

Human dialogue, in particular, task oriented di- 
alogue is characterised by a large numbers of self- 
repairs (Levelt 1983, Carletta et al. 1993), such as 
hesitations, insertions, and replacements. It is also 
common to find interruptions requesting extra clarifi- 
cation, or disagreements before the end of a sentence. 
It is even possible for sentences started by one dia- 
logue participant to be finished by another. Applica- 
tions involving the understanding of dialogues include 
information extraction from conversational databases, 
or computer monitoring of conversations. It also may 
be useful to include some features of human dialogue 
in man-machine dialogue. For example, interruptions 
can be used for early signalling of errors and ambigu- 
ities. 

Let us first consider some examples of self-repair. 
Insertions add extra information, usually modifiers 
e.g. 

2) We start in the middle with in the middle of 
the paper with a blue disc (Levelt 1983:ex.3) 

Replacements correct pieces of information e.g. 

3) Go from left again to uh from pink again to 
blue (Levelt 1983:ex.2) 

In some cases information from the corrected material 
is incorporated into the final message. For example, 
consider^] : 

1 Joint Councils Initiative in Cognitive Science/HCI, Grant 
8826213, EdCAAD and Centre for Cognitive Science, Univer- 
sity of Edinburgh. 

2 This example was inspired by the work of Haddock (1987) 
on incremental interpretation of definite noun phrases. Had- 
dock used an incremental constraint based approach following 
Mellish (1985) to provide an explanation of why it is possible 
to use the noun phrase the rabbit in the hat even when there 
are two hats, but only one hat with a rabbit in it. 

3 Example (a) is reconstructed from an actual utterance. Ex- 
amples (b) and (c) were constructed. 



4) a The three main sources of data come, uh 

they can be found in the references 
b John noticed that the old man and his wife, uh 
that the man got into the car and the wife 

was with him when they left the house 
c Every boy took, uh he should have taken a 

water bottle with him 

In (a), the corrected material the three main sources 
of data come provides the antecedent for the pronoun 
they. In (b) the corrected material tells us that the 
man is both old and has a wife. In (c), the pronoun 
he is bound by the quantifier every boy. 

For a system to understand dialogues involving self- 
repairs such as those in (4) would seem to require 
either an ability to interpret incrementally, or the 
use of a grammar which includes self repair as a syn- 
tactic construction akin to non-constituent coordina- 
tion (the relationship between coordination and self- 
correction is noted by Levelt (1983)). For a system 
to generate self repairs might also require incremen- 
tal interpretation, assuming a process where the sys- 
tem performs on-line monitoring of its output (akin to 
Levelt's model of the human self-repair mechanism). 
It has been suggested that generation of self repairs is 
useful in cases where there are severe time constraints, 
or where there is rapidly changing background infor- 
mation (Carletta, p.c). 

A more compelling argument for incremental in- 
terpretation is provided by considering dialogues in- 
volving interruptions. Consider the following dialogue 
from the TRAINS corpus (Gross et al., 1993): 

5) A: so we should move the engine at Avon, 
engine E, to ... 

B: engine El 
A: El 
B: okay 

A: engine El, to Bath ... 

This requires interpretation by speaker B before the 
end of A's sentence to allow objection to the appo- 
sition, the engine at Avon, engine E. An example of 
the potential use of interruptions in human computer 
interaction is the following: 

6) User: Put the punch onto ... 

Computer: The punch can't be moved. It's 
bolted to the floor. 

In this example, interpretation must not only be be- 
fore the end of the sentence, but before a constituent 
boundary (the verb phrase in the user's command has 
not yet been completed). 

CURRENT TOOLS 

1. Syntax to Semantic Representation 

In this section we shall briefly review work on pro- 
viding semantic representations (e.g. lambda expres- 
sions) word by word. Traditional layered models of 



sentence processing first build a full syntax tree for a 
sentence, and then extract a semantic representation 
from this. To adapt this to an incremental perspec- 
tive, we need to be able to provide syntactic structures 
(of some sort) for fragments of sentences, and be able 
to extract semantic representations from these. 

One possibility, which has been explored mainly 
within the Categorial Grammar tradition (e.g. Steed- 
man 1988) is to provide a grammar which can treat 
most if not all initial fragments as constituents. They 
then have full syntax trees from which the semantics 
can be calculated. 

However, an alternative possibility is to directly 
link the partial syntax trees which can be formed for 
non-constituents with functional semantic representa- 
tions. For example, a fragment missing a noun phrase 
such as John likes can be associated with a seman- 
tics which is a function from entities to truth values. 
Hence, the partial syntax tree given in Fig. lQ, 

s 
/ \ 
np vp 
John / \ 

v np 
likes I 

Fig. 1 

can be associated with a semantic representation, 
Ax. likes(john,x). 

Both Categorial approaches to incremental inter- 
pretation and approaches which use partial syntax 
trees get into difficulty in cases of left recursion. Con- 
sider the sentence fragment, Mary thinks John. A 
possible partial syntax tree is provided by Fig. 2. 

s 
/ \ 
np vp 
Mary / \ 

v s 
thinks / \ 

np vp 
John 4 

Fig. 2 

However, this is not the only possible partial tree. 
In fact there are infinitely many different trees possi- 
ble. The completed sentence may have an arbitrarily 
large number of intermediate nodes between the lower 
s node and the lower np. For example, John could 
be embedded within a gerund e.g. Mary thinks John 
leaving here was a mistake, and this in turn could be 
embedded e.g. Mary thinks John leaving here being 

4 The downarrow notation for missing constituents is 
adopted from Synchronous Tree Adjoining Grammar (Shieber 
& Schabes 1990). 



a mistake is surprising. John could also be embed- 
ded within a sentence which has a sentence modifier 
requiring its own s node e.g. Mary thinks John will 
go home probably^, and this can be further embedded 
e.g. Mary thinks John will go home probably because 
he is tired. 

The problem of there being an arbitrary number of 
different partial trees for a particular fragment is re- 
flected in most current approaches to incremental in- 
terpretation being cither incomplete, or not fully word 
by word. For example, incomplete parsers have been 
proposed by Stabler (1991) and Moortgat (1988). Sta- 
bler 's system is a simple top-down parser which does 
not deal with left recursive grammars. Moortgat 's M- 
System is based on the Lambek Calculus: the prob- 
lem of an infinite number of possible tree fragments 
is replaced by a corresponding problem of initial frag- 
ments having an infinite number of possible types. A 
complete incremental parser, which is not fully word 
by word, was proposed by Pulman (1986). This is 
based on arc-eager left-corner parsing (see e.g. Resnik 
1992). 

To enable complete, fully word by word parsing re- 
quires a way of encoding an infinite number of partial 
trees. There are several possibilities. The first is to 
use a language describing trees where we can express 
the fact that John is dominated by the s node, but do 
not have to specify what it is immediately dominated 
by (e.g. D-Theory, Marcus et al. 1983). Semantic 
representations could be formed word by word by ex- 
tracting 'default' syntax trees (by strengthening dom- 
inance links into immediated dominance links wher- 
ever possible). 

A second possibility is to factor out recursive struc- 
tures from a grammar. Thompson et al. (1991) show 
how this can be done for a phrase structure gram- 
mar (creating an equivalent Tree Adjoining Grammar 
(Joshi 1987)). The parser for the resulting grammar 
allows linear parsing for an (infinitely) parallel sys- 
tem, with the absorption of each word performed in 
constant time. At each choice point, there are only 
a finite number of possible new partial TAG trees 
(the TAG trees represents the possibly infinite num- 
ber of trees which can be formed using adjunction). 
It should again be possible to extract 'default' seman- 
tic values, by taking the semantics from the TAG tree 
(i.e. by assuming that there are to be no adjunctions). 
A somewhat similar system has recently been pro- 
posed by Shieber and Johnson (1993). 

The third possibility is suggested by considering 
the semantic representations which are appropriate 
during a word by word parse. Although there are 
any number of different partial trees for the fragment 
Mary thinks John, the semantics of the fragment can 



5 The treatment of probably as a modifier of a sentence 
is perhaps controversial. However, treatment of it as a verb 
phrase modifier would merely shift the potential left recursion 
to the verb phrase node. 



be represented using just two lambda expressions^: 

AP. thinks(mary,P(john)) 

AP. AQ. Q(thinks(mary,P(john))) 

Consider the first. The lambda abstraction (over a 
functional item of type e— >t) can be thought of as 
a way of encoding an infinite set of partial semantic 
(tree) structures. For example, the eventual semantic 
structure may embed john at any depth e.g. 

thinks(mary,sleeps(john)) 

thinks (mary,possibly (sleeps (john) ) ) 

etc. 

The second expression (a functional item over type 
e— >t and t— >t), allows for eventual structures where 
the main sentence is embedded e.g. 

possibly (thinks (marysleeps (john) ) ) 

This third possibility is therefore to provide a syn- 
tactic correlate of lambda expressions. In practice, 
however, provided we are only interested in map- 
ping from a string of words to a semantic represen- 
tation, and don't need explicit syntax trees to be con- 
structed, we can merely use the types of the 'syntac- 
tic lambda expressions', rather than the expressions 
themselves. This is essentially the approach taken in 
Milward (1992) in order to provide complete, word 
by word, incremental interpretation using simple lex- 
icalised grammars, such as a lexicalised version of for- 
mal dependency grammar and simple categorial gram- 
mar]]. 

2. Logical Forms to Semantic Filtering 

In processing the sentence Mary introduced John to 
Susan, a word-by-word approach such as Milward 
(1992) provides the following logical forms after the 
corresponding sentence fragments are absorbed: 

Mary AP.P(mary) 

Mary introduced Ax.Ay.intr(mary,x,y) 

Mary introduced John Ay.intr(mary,jofm,y) 

Mary introduced John to Ay.intr(mary,jofm,y) 

Mary introduced John to Sue intr(mary,john,sue) 

Each input level representation is appropriate for the 
meaning of an incomplete sentence, being either a 
proposition or a function into a proposition. 

In Chater et al. (1994) it is argued that the in- 
crementally derived meanings are not judged for 
plausibility directly, but instead are first turned 
into existentially quantified propositions. For 
example, instead of judging the plausibility of 



Ax.Ay.intr(mary,x,y), we judge the plausibility of 
3(x,T,3(y,T,intr(mary,x,y)))|. This is just the 
proposition Mary introduced something to something 
using a generalized quantifier notation of the form 
Quantifier (Variable, Restrictor, Body). 

Although the lambda expressions are built up 
monotonically, word by word, the propositions formed 
from them may need to be retracted, along with all 
the resulting inferences. For example, Mary intro- 
duced something to something is inappropriate if the 
final sentence is Mary introduced noone to anybody. A 
rough algorithm is as follows: 

1. Parse a new word, Word^ 

2. Form a new lambda expression by combining the 
lambda expression formed after parsing Wordi_i with 
the lexical semantics for Word.; 

3. Form a proposition, P^, by existentially quantify- 
ing over the lambda abstracted variables. 

4. Assert P^. If P, does not entail P,-i retract Pj_i 
and all conclusions made from it^. 

5. Judge the plausibility of P*. If implausible block 
this derivation. 

It is worth noting that the need for retraction is not 
due to a failure to extract the correct 'least commit- 
ment' proposition from the semantic content of the 
fragment Mary introduced. This is due to the fact that 
it is possible to find pairs of possible continuations 
which are the negation of each other (e.g. Mary intro- 
duced noone to anybody and Mary introduced someone 
to somebody). The only proposition compatible with 
both a proposition, p, and its negation, ->p is the 
trivial proposition, T (see Chater et al. for further 
discussion) . 

3. Incremental Quantifier Scoping 

So far we have only considered semantic representa- 
tions which do not involve quantifiers (except for the 
existential quantifier introduced by the mechanism 
above) . 

In sentences with two or more quantifiers, there 
is generally an ambiguity concerning which quanti- 
fier has wider scope. For example, in sentence (a) 
below the preferred reading is for the same kid to 
have climbed every tree (i.e. the universal quantifier 
is within the scope of the existential) whereas in sen- 
tence (b) the preferred reading is where the universal 
quantifier has scope over the existential. 

7) a A tireless kid climbed every tree, 
b There was a fish on every plate. 



6 Two representations are appropriate if there are no VP- 
modifiers as in dependency grammar. If VP-modification is 
allowed, two more expressions are required: 
AP. AR. (R(Ax.thinks(x,P(john))))(mary) and 
AP. AR. AQ. Q((R(Ax.thinks(x,P(john))))(mary)). 

7 The version of categorial grammar used is AB Categorial 
Grammar with Associativity. 



8 The proposition T is always true. See Chater et al. (1994) 
for discussion of whether it is more appropriate to use a non- 
trivial restrictor. 

9 Retraction can be performed by using a tagged database, 
where each proposition is paired with a set of sources e.g. 
given (P-^Q,{u4}), and (P,{u5}) thcn(Q,{u4,u5}) can be 
deduced. 



Scope preferences sometimes seem to be established 
before the end of a sentence. For example, in sentence 
(a) below, there seems a preference for an outer scope 
reading for the first quantifier as soon as we interpret 
child. In (b) the preference, by the time we get to e.g. 
grammar, is for an inner scope reading for the first 
quantifier. 

8) a A teacher gave every child a great deal of home- 

work on grammar. 

b Every girl in the class showed a rather strict 
new teacher the results of her attempt to get 
the grammar exercises correct. 

This intuitive evidence can be backed up by consid- 
ering garden path effects with quantifier scope am- 
biguities (called jungle paths by Barwise 1987). The 
original examples, such as the following, 

9) Statistics show that every 11 seconds a man is 
mugged here in New York city. We are here today 
to interview him 

showed that preferences for a particular scope are es- 
tablished and are overturned. To show that prefer- 
ences are sometimes established before the end of a 
sentence, and before a potential sentence end, we need 
to show garden path effects in examples such as the 
following: 

10) Mary put the information that statistics show 
that every 11 seconds a man is mugged here in 
New York city and that she was to interview him 
in her diary 

Most psycholinguistic experimentation has been con- 
cerned with which scope preferences are made, rather 
than the point at which the preferences are estab- 
lished (see e.g. Kurtzman and MacDonald, 1993). 
Given the intuitive evidence, our hypothesis is that 
scope preferences can sometimes be established early, 
before the end of a sentence. This leaves open the 
possibility that in other cases, where the scoping in- 
formation is not particularly of interest to the hearer, 
preferences are determined late, if at all. 

3.1 Incremental Quantifier Scoping: Imple- 
mentation 

Dealing with quantifiers incrementally is a rather sim- 
ilar problem to dealing with fragments of trees incre- 
mentally. Just as it is impossible to predict the level 
of embedding of a noun phrase such as John from the 
fragment Mary thinks John, it is also impossible to 
predict the scope of a quantifier in a fragment with 
respect to the arbitrarily large number of quantifiers 
which might appear later in the sentence. Again the 
problem can be avoided by a form of packing. A par- 
ticularly simple way of doing this is to use unscoped 
logical forms where quantifiers are left in situ (simi- 
lar to the representations used by Hobbs and Shieber 
(1987), or to Quasi Logical Form (Alshawi 1990)). For 



example, the fragment Every man gives a book can be 
given the following representation: 

11) Az.gives(< V,x,man(x)>,< 3,y,book(y)>,z) 

Each quantified term consists of a quantifier, a vari- 
able and a restrictor, but no body. To convert lambda 
expressions to unscoped propositions, we replace an 
occurrence of each argument with an empty existen- 
tial quantifier term. In this case we obtain: 

12) gives(< V,x,man(x)>,< 3,y,book(y)>,< 3,z,T>) 

Scoped propositions can then be obtained by using an 
outside-in quantifier scoping algorithm (Lewin, 1990), 
or an inside-out algorithm with a free variable con- 
straint (Hobbs and Shieber, 1987). The propositions 
formed can then be judged for plausibility. 

To imitate jungle path phenomena, these plausi- 
bility judgements need to feed back into the scoping 
procedure for the next fragment. For example, if ev- 
ery man is taken to be scoped outside a book after 
processing the fragment Every man gave a book, then 
this preference should be preserved when determining 
the scope for the full sentence Every man gave a book 
to a child. Thus instead of doing all quantifier scop- 
ing at the end of the sentence, each new quantifier is 
scoped relative to the existing quantifiers (and opera- 
tors such as negation, intensional verbs etc.). A pre- 
liminary implementation achieves this by annotating 
the semantic representations with node names, and 
recording which quantifiers are 'discharged' at which 
nodes, and in which order. 

DYNAMIC SEMANTICS 

Dynamic semantics adopts the view that "the mean- 
ing of a sentence does not lie in its truth conditions, 
but rather in the way in which it changes (the rep- 
resentation of) the information of the interpreter" 
(Groenendijk and Stokhof, 1991). At first glance such 
a view seems ideally suited to incremental interpreta- 
tion. Indeed, Groenendijk and Stokhof claim that the 
compositional nature of Dynamic Predicate Logic en- 
ables one to "interpret a text in an on-line manner, 
i.e., incrementally, processing and interpreting each 
basic unit as it comes along, in the context created 
by the interpretation of the text so far" . 

Putting these two quotes together is, however, mis- 
leading, since it suggests a more direct mapping be- 
tween incremental semantics and dynamic semantics 
than is actually possible. In an incremental seman- 
tics, we would expect the information state of an 
interpreter to be updated word by word. In con- 
trast, in dynamic semantics, the order in which states 
are updated is determined by semantic structure, not 
by left-to-right order (see e.g. Lewin, 1992 for dis- 
cussion). For example, in Dynamic Predicate Logic 
(Groenendijk & Stokhof, 1991), states are threaded 
from the antecedent of a conditional into the consc- 



quent, and from a restrictor of a quantifier into the 
body. Thus, in interpreting, 

13) John will buy it right away, if a car impresses him 

the input state for evaluation of John will buy it right 
away is the output state from the antecedent a car 
impresses him. In this case the threading through 
semantic structure is in the opposite order to the order 
in which the two clauses appear in the sentence. 

Some intuitive justification for the direction of 
threading in dynamic semantics is provided by con- 
sidering appropriate orders for evaluation of proposi- 
tions against a database: the natural order in which 
to evaluate a conditional is first to add the antecedent, 
and then see if the consequent can be proven. It is 
only at the sentence level in simple narrative texts 
that the presentation order and the natural order of 
evaluation necessarily coincide. 

The ordering of anaphors and their antecedents is 
often used informally to justify left-to-right threading 
or threading through semantic structure. However, 
threading from left-to-right disallows examples of op- 
tional cataphora, as in example (13), and examples 
of compulsory cataphora as in: 

14) Beside her, every girl could see a large crack 

Similarly, threading from the antecedents of condi- 
tionals into the consequent fails for examples such 
as: 

15) Every boy will be able to see out of a window if 
he wants to 

It is also possible to get sentences with 'donkey' read- 
ings, but where the indefinite is in the consequent: 

16) A student will attend the conference if we can get 
together enough money for her air fare 

This sentence seems to get a reading where we are not 
talking about a particular student (an outer existen- 
tial), or about a typical student (a generic reading). 
Moreover, as noted by Zeevat (1990), the use of any 
kind of ordered threading will tend to fail for Bach- 
Peters sentences, such as: 

17) Every man who loves her appreciates a woman 
who lives with him 

For this kind of example, it is still possible to use a 
standard dynamic semantics, but only if there is some 
prior level of reference resolution which reorders the 
antecedents and anaphors appropriately. For exam- 
ple, if (17) is converted into the 'donkey' sentence: 

18) Every man who loves a woman who lives with him 
appreciates her 

When we consider threading of possible worlds, as 
in Update Semantics (Veltman 1990), the need to dis- 
tinguish between the order of evaluation and the order 



of presentation becomes more clear cut. Consider try- 
ing to perform threading in left-to-right order during 
interpretation of the sentence, John left if Mary left. 
After processing the proposition John left the set of 
worlds is refined down to those worlds in which John 
left. Now consider processing if Mary left. Here we 
want to reintroduce some worlds, those in which nei- 
ther Mary or John left. However, this is not allowed 
by Update Semantics which is eliminative: each new 
piece of information can only further refine the set of 
worlds. 

It is worth noting that the difficulties in trying 
to combine eliminative semantics with left-to-right 
threading apply to constraint-based semantics as well 
as to Update Semantics. Haddock (1987) uses incre- 
mental refinement of sets of possible referents. For ex- 
ample, the effect of processing the rabbit in the noun 
phrase the rabbit in the hat is to provide a set of all 
rabbits. The processing of in refines this set to rab- 
bits which are in something. Finally, processing of the 
hat refines the set to rabbits which are in a hat. How- 
ever, now consider processing the rabbit in none of the 
boxes. By the time the rabbit in has been processed, 
the only rabbits remaining in consideration are rab- 
bits which are in something. This incorrectly rules 
out the possibility of the noun phrase referring to a 
rabbit which is in nothing at all. The case is actually 
a parallel to the earlier example of Mary introduced 
someone to something being inappropriate if the final 
sentence is Mary introduced noone to anybody. 

Although this discussion has argued that it is not 
possible to thread the states which are used by a 
dynamic or eliminative semantics from left to right, 
word by word, this should not be taken as an argu- 
ment against the use of such a semantics in incre- 
mental interpretation. What is required is a slightly 
more indirect approach. In the present implementa- 
tion, semantic structures (akin to logical forms) are 
built word by word, and each structure is then evalu- 
ated independently using a dynamic semantics (with 
threading performed according to the structure of the 
logical form). 

IMPLEMENTATION 

At present there is a limited implementation, which 
performs a mapping from sentence fragments to fully 
scoped logical representations. To illustrate its oper- 
ation, consider the following discourse: 

19) London has a tower. Every parent shows it ... 

We assume that the first sentence has been processed, 
and concentrate on processing the fragment. The im- 
plementation consists of five modules: 

1. A word- by- word incremental parser for a lex- 
icalised version of dependency grammar (Milward, 
1992). This takes fragments of sentences and maps 
them to unscoped logical forms. 



INPUT: Every parent shows it 

OUTPUT: 

Az.show(< V,x, parent (x) > ,<pronoun,y > ,z) 

2. A module which replaces lambda abstracted vari- 
ables with existential quantifiers in situ. 

INPUT: Output from 1. 

OUTPUT: show(< V,x,parent(x)>,<pronoun,y>,< 

3, z,T>) 

3. A pronoun coindcxing procedure which replaces 
pronoun variables with a variable from the same sen- 
tence, or from the preceding context. 

INPUT: Output(s) from 2 and a list of variables avail- 
able from the context. 

OUTPUT: show(< V,x,parent(x)>,w,< 3,z,T>) 

4. An outsidc-in quantifier scoping algorithm based 
on Lcwin (1990). 

INPUT: Output from 3. 

OUTPUT1: V(x,parent(x),3(z,T,show(x,w,z))) 
OUTPUT2: 3(z,T,V(x,parent(x),show(x,w,z))) 

5. An 'evaluation' procedure based on Lewin (1992), 
which takes a logical form containing free variables 
(such as the w in the LF above), and evaluates it us- 
ing a dynamic semantics in the context given by the 
preceding sentences. The output is a new logical form 
representing the context as a whole, with all variables 
correctly bound. 

INPUT: Output(s) from 4, and the context, 
3(w,T,tower(w) &: has(london,w)) 
OUTPUT1: 3(w,T,tower(w) & has(london,w) 
&i V(x, parent (x),3(z,T,show(x,w,z)))) 
OUTPUT2: 3(w,T,3(z,T,tower(w) & has(london,w) 
&l V(x, parent (x),show(x,w,z)))) 

At present, the coverage of module 5 is limited, and 
module 3 is a naive coindexing procedure which al- 
lows a pronoun to be coindexed with any quantified 
variable or proper noun in the context or the current 
sentence. 

CONCLUSIONS 

The paper described some potential applications of in- 
cremental interpretation. It then described the series 
of steps required in mapping from initial fragments 
of sentences to propositions which can be judged for 
plausibility. Finally, it argued that the apparently 
close relationship between the states used in incre- 
mental semantics and dynamic semantics fails to hold 
below the sentence level, and briefly presented a more 
indirect way of using dynamic semantics in incremen- 
tal interpretation. 
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